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I  Introduction 


Throughout  this  paper,  we  shall  only  consider  the  unidimensional 

latent  space  in  the  context  of  latent  trait  theory,  and  the  dichotomous 

response  level  (Samejlma,  1972),  on  which  the  item  is  scored  either 

right  or  wrong.  Let  0  be  the  latent  trait,  and  u  be  the  binary 

S 

item  score  for  item  g  .  The  operating  characteristic  of  the  item  score 

u^  =  1  ,  or  the  conditional  probability  with  which  the  examinee  answers 

item  g  correctly,  given  6  ,  is  called  the  item  characteristic  function 

(Lord  and  Novick,  1968),  and  is  denoted  by  P  (6)  .  This  item 

characteristic  function  can  be  any  function  of  6  ,  which  relates  the 

binary  item  to  ability  6  .  When  the  item  has  a  relatively  simple 

positive  relationship  with  ability  0  ,  however,  it  is  natural  to  consider 

a  strictly  increasing  function  for  its  item  characteristic  function. 

Many  existing  models  follow  this  rule,  including  the  normal  ogive  model, 

the  logistic  model,  Rasch  model,  and  the  three-parameter  normal  ogive 

and  logistic  models.  Throughout  this  paper,  we  shall  solely  consider 

strictly  increasing  item  characteristic  functions  in  a  broader  sense. 

Let  A  (0)  be  the  basic  function  (Samejima,  1969,  1972)  of 

item  score  u  .  We  can  write 
g 


where 


q  (0)  =  1  -  P  (0)  . 

o  o 


(1.2) 


The  response  pattern,  V  ,  for  the  set  of  n  binary  Items  Is  given  by 


(1.3)  V  =  (u, ,  u,,  u  ,  ....  u  )'  . 

12  g  n 


When  local  Independence  holds,  the  operating  characteristic,  , 

of  the  response  pattern  V  can  be  written  as  the  product  of  the  n 


operating  characteristics  of  the  Item  responses  In  V  ,  that  Is 


u  1-u 

(1.4)  P^,(9)  -  n  P  (0)  ®  Q„(8)  ® 

^  u  eV  8  8 

g 


Since  P^(0)  also  the  likelihood  function,  1*^(6)  ,  used  In  estimating 
the  latent  trait  for  the  examinee  with  the  particular  response  pattern 


V  ,  we  can  write  for  the  likelihood  equation 


(1.5)  ^  log  1,(6)  -  ^  log  P,(e)  -  £  A  (6)  -  0  , 

V’  8 


where  A  (6)  Is  the  basic  function  defined  by  (1.1).  When  a  simple 
u 

g 

sufficient  statistic  for  the  response  pattern  V  does  not  exist,  these 
basic  functions  play  an  Important  role  In  obtaining  the  maximum  likelihood 
estimate  of  ability  9  ,  as  Is  obvious  from  (1.5). 


The  item  response  Information  function,  I  (9)  ,  is  defined  by 

“g 


g  g 


Thus,  If  the  basic  function  Is  strictly  decreasing  In  9  ,  then  the 


item  response  Infomiatlon  function  Is  positive  except,  at  most,  at 

an  enumerable  points  of  6  .  The  item  information  function,  I  (6)  , 

S 

of  item  g  is  given  as  the  conditional  expectation  of  the  item  response 
information  function,  given  0  .  We  can  write 

(1.7)  ye)  -  Eti^  (e)|el  -  (^ye)]^  0^(6)'^  +  ys) 

s 

OO  g  g  g 

It  is  obvious  from  (1.7)  that  the  item  information  function  is 
non-negative  in  nature.  The  response  pattern  Information  function, 

1^(0)  ,  is  defined  by 

(1.8)  I  (0)  =  -  ^  log  P  (0)  =  E  I  (0)  , 

''  ^  u  cV  “g 

and  the  test  information  function,  1(6)  ,  is  given  as  the  conditional 
expectation  of  the  response  pattern  Information  function,  given  6  . 

Thus  we  can  write 

n 

(1.9)  1(0)  =  E[T  (0)|0]  =  I  I  (e)  P  (6)  =  E  I  (0)  . 

V  ''  ''  g*l  ® 

When  the  item  score  is  based  upon  the  true  understanding  of  the  question, 
or  "knowledge",  by  the  examinee,  the  item  characteristic  function 
specifies  the  probability  assigned  to  the  strict  "knowledge",  given 
ability  0  .  On  the  other  hand,  if  the  item  has  a  multiple-choice 


format,  the  item  score  is  based  not  only  upon  the  "knowledge”  but 
also  upon  the  chance  success.  Thus  in  such  a  case  the  effect  of 
noise  more  or  less  contaminates  the  resultant  item  characteristic 
function,  and  may  cause  serious  problems,  as  was  observed  in  the 
three-parameter  models  (Samejlma,  1972,  1973b).  It  is  advisable  to 
avoid  such  contamination  by  devising  the  instructions  of  the  test  in 
such  a  way  as  to  discourage  examinees  from  guessing,  by  including 
informative  distractors  among  the  alternatives  of  the  multiple-choice 
test  item,  and  so  forth  (cf.  Samejlma,  RR-79-4) . 

Because  of  the  Increasing  Interest  in  the  three-parameter 
logistic  model  (Bimbaum,  1968)  in  practical  applications,  however,  it 
will  be  meaningful  to  further  investigate  the  effect  of  noise  in 
ability  estimation.  In  the  present  paper,  such  an  attempt  is  made 
with  regard  to  the  information  loss  and  the' speed  of  convergence  of 
the  conditional  distribution  of  the  maximum  likelihood  estimate  of 
ability  0  ,  given  0  ,  to  normality. 

II  Four  Types  of  Models  for  Dichotomous  Test  Items 

We  assume  that  the  item  characteristic  function,  P  (6)  ,  ■'’s 

% 

strictly  increasing  in  0  ,  for  the  interval 

(2.1)  0  <  0  <  0  . 

These  lower  and  upper  endpoints  of  0  can  either  be  negative  and 
positive  infinities,  respectively,  or  finite  numbers.  The  interval, 
(0,0)  ,  can  either  be  the  whole  range  of  ability  0  which  is  common 
for  all  items,  or  a  subinterval  specified  for  the  particular  item 
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characteristlc  function.  Let  c  .  and  c  .  denote  the  lower  and  upper 

gl  g2 

asymptotes  of  the  item  characteristic  function.  Thus  we  can  write 
f  lim 


(2.2) 


P  (0)  “  C  T 
9^0  g  gl 

lim  „ 

e^e  “  ‘'g2  ’ 


where 


(2.3) 


Ojc,  <c-<l. 

gl  g2 


We  shall  call  the  set  of  models,  in  which  c  ,  =  0  and  c  „  =  1  , 

gi  g2 

Type  A  .  Such  models  as  the  normal  ogive  model  (Lord  and  Novick,  1968) , 

the  logistic  model  (Bimbaum,  1968) ,  the  linear  model  (Lazarsfeld,  1959) 

and  the  constant  information  model  (Samejima,  RR-79-1),  belong  to 

Type  A  .  Note  that  in  the  former  two  models  the  interval  (9,9)  is 

the  total  range  of  ability  0  ,  while  in  the  latter  two  models  it  is  a 

sub interval  specified  for  each  individual  test  item.  In  contrast  to 

Type  A  ,  the  set  of  models  in  which  c^^^  is  greater  than  zero  and 

less  than  unity  is  called  Type  D  .  In  addition  to  the  above  two  types  of 

models,  we  consider  Type  B  and  Type  C  ,  in  which  is  greater  than 

zero  and  c  „  =  1  ,  and  c  ,  =  0  and  c  „  is  less  than  unity, 
g2  gl  g2 

respectively.  They  are  summarized  in  Table  2-1. 

Figure  2-1  presents  examples  of  the  item  characteristic  functions 
r  th  above  four  types  of  models.  In  these  four  examples,  the  item 
characteristic  functions  are  given  by 


(2. A) 


+  (c  _-c  ,)  4-  (9)  , 
g  gl  g2  gl  g  ’ 


TABLE  2-1 


Relationship  between  the  Lower  and  Upper  Asymptotes 
of  the  Item  Characteristic  Function  for  Each  of  the 
Four  Types  of  Models  for  Binary  Test  Items. 


Type  A 
Type  B 
Type  C 
Type  D 


0  <  Cgl  <  '92  =  ' 

“  =  <^91  ‘  '=92  '  ' 

°  '  <=91  '  ^2  '  ' 


where  item  characteristic  function  of  the  normal  ogive 

model,  which  is  given  by 


(2.5) 


4-  (0)  =  (2Tr) 
g 


-1/2 


/: 


a  (e-b„) 
g  g 


-u^/2 

e  du  , 


with  the  parameters,  a  =1.0  and  b  =  0.0  .  For  Types  B  and  D  , 

g  g 

we  have  c^j^  =  0.2  ,  and,  for  Types  C  and  D  ,  0^2  =  0.8  .  We  notice 
that  the  example  for  Type  A  which  is  given  in  Figure  2-1  is  the 
normal  ogive  model,  and  that  for  Type  B  is  the  three-parameter  normal 
ogive  model. 

We  have  no  specific  models  of  Types  C  and  D  which  are  commonly 
used,  although  the  author  has  come  across  some  researchers  who  have 
thought  of  Type  C  models.  In  the  present  paper,  however,  we  include 
both  Type  C  and  Type  D  ,  in  order  to  Investigate  the  effect  of  noise 
which  affects  the  upper  asymptote  of  the  item  characteristic  function 


as  well  as  the  lower  asymptote. 


TYPE  A 


a  eo  CD  CM  ( 

2  d  o  d  d  ( 

NOIi.9Nn<  OUtlMBXSVHVHO  HaXi 


a  00  (D  V  CM  c 

2  d  d  d  o  < 

NOIXONnrf  OUSWaiOVMVHO  «W1I 


FIGURE  2-1 

Examples  of  item  characteristic  functions  of  Types 
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III  Information  Loss 

The  item  Information  function,  as  well  as  the  test  Information 
function,  has  been  used  as  a  measure  of  accuracy  In  estimating  the 
examinee's  ability,  which  Is  specified  locally,  or  for  fixed  values  of 
ability  6  .  This  characteristic  of  the  Item  information  function  enables 
us  to  compare  two  or  more  different  Items  with  respect  to  their  local 
accuracy  In  ability  estimation,  and  to  decide  which  item  is  best  for  a 
particular  ability  level.  In  spite  of  this  fact.  It  has  been  pointed 
out  (Samejlma,  RR-79-1)  that  there  exists  some  constancy  in  item 
Information  among  all  Items  which  belong  to  the  same  type. 

Let  T  be  a  strictly  increasing  transformation  of  0  such  that 


(3.1)  T  »  t(0)  . 

We  can  write  for  the  Item  information  function,  I*(t)  ,  of  item  g  on 

8 

the  transformed  latent  trait 


(3.2)  I*(t)  =  I  (0) [§7]^  . 

g  g  dx 


Thus  we  obtain 


(3.3) 


[I*(x)]^^^  dx 
g 


1/2 

f 1  (0)1  '  de  , 
0  ® 


where  x  and  1  are  given  by 


(3.4) 


'  X  -  r (0) 

T  *  X (0)  . 


We  notice  that  an  item  characteristic  function  of  a  specified 
model  with  given  parameter  values  can  be  transformed  to  another,  which 
belongs  to  the  same  model  but  with  different  values  of  parameters,  by  a 
strictly  Increasing  transformation  of  the  latent  trait  0  .  Thus  (3.3) 
implies  that  the  area  under  the  curve  of  the  square  root  of  the  Item 
Information  function  Is  constant  for  all  the  Item  characteristic  functions 
which  belong  to  the  same  model,  although  each  item  may  have  a  different 
amount  of  Information  for  any  fixed  value  of  6  .  This  constancy  of  Item 
Information  Is  expanded  to  all  the  Item  characteristic  functions  which 
belong  to  different  models  of  the  same  type.  It  has  been  shown  that  this 
area  equals  tt  for  all  the  models  of  Type  A  . 

It  should  be  noted  that  the  relationship  given  in  (3.3)  can  be 
expanded  for  any  subinterval  of  (0,  9)  .  Let  (9,  9)  be  an  arbitrary 
subinterval  of  (9,  9)  .  Thus  we  have 

(3.5)  (9,  9)  S(9,  9)  . 

We  can  write 


(3.6) 


[I*(t)1^^^  dT 
g 


f  ^  U  (9)]^^^  d0  , 

j  0  8 


where  t  and  t  are  given  by 


(3.7) 


r  1  ^  t(9) 

[  T  =  T(e)  . 


Equation  (3.6)  also  Implies  that  the  constancy  of  item  information  applies 
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for  different  models  which  belong  to  different  types.  In  this  case, 
however,  the  areas  are  not  necessarily  the  total  areas  but  those  for 
specified  subintervals.  To  give  an  example,  let  us  consider  the  four 
Item  characteristic  functions  of  Types  A  ,  B  ,  C  and  D  ,  which  are  given 
in  the  preceding  chapter.  If  we  set  t  =  -«“  and  t  =  ®  for  each  of  the 
last  three  item  characteristic  functions  of  Types  B  ,  C  and  D  ,  then  the 
corresponding  values  of  6  and  6  for  the  first  item  characteristic 
function,  l.e.,  that  of  the  normal  ogive  model  with  the  parameters, 

a  =  1.0  and  b  *  0.0  ,  are:  1)  6  =  y  ^(c  ,)  and  0  «  «  for  Type  B  , 
g  g  *  gl 

2)  0  =  and  0  =  ^  ^(c  «)  for  Type  C  ,  and  3)  0  =  f  ^(c  )  and 

*  g  g^  =  8  gl 

0  a  41  ^(c  )  for  Type  D  .  Thus  when  c  ,  =  0.2  and  c  -  =  0.8  ,  as  is 

g  g2  gl  g2 

Illustrated  in  Figure  2-1,  we  obtain  ^(c  ,)  ••  -0.84  and  ^^(c  -)  •  0.84  . 

g  gl  g  g2 

It  has  been  pointed  out  (Samejima,  1972,  1973b)  that  models  of 
Type  B  ,  such  as  Che  three-parameter  logistic  model  and  Che  three- parameter 
normal  ogive  model,  provide  us  with  sub Intervals  of  0  for  which  the 
item  response  information  function  for  u  =  1  assumes  negative  values. 

s 

It  can  be  observed  easily  that  the  same  is  true  for  those  which  belong 
to  Type  C  or  Type  D  .  It  is  questionable,  therefore,  that  the  item 
information  function  is  as  meaningful  for  those  models  of  Types  B  and  C  as 
it  is  for  those  which  belong  to  Type  A  and  whether  it  assures  a  unique  maximum 
for  the  likelihood  function  for  each  and  every  response  pattern,  as  is 
the  case  with  the  normal  ogive  and  logistic  models  (Samejima,  1969, 

1972).  For  the  moment,  however,  let  us  keep  this  question  open,  and 
proceed  to  investigate  the  item  information  loss  caused  by  different 
characteristics  of  models.  Let  h  be  a  binary  test  item  which  belongs 
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to  Type  A  .  We  shall  transform  the  latent  trait  9  to  t  in  such  a 
way  that 


(3.8) 


T  =  T(e)  =  P?~^[P  (6)]  , 
n  8 


where  P^(t)  is  the  item  characteristic  function  of  Type  A  defined  on  t 
Thus  T  is  a  strictly  increasing  function  of  6  with  the  range 

(3.9)  T  <  T  <  T  , 

where 

r  I  =  P*'^[P„(0)]  =  P*‘^(c  ) 

J  -  h  g  -  h  gi 

( .  -1  -  .1 
I  t  -  P.  hp^(6)  I  -  P*  • 

For  convenience,  and  without  loss  of  generality,  let  h  follow  the 
logistic  model,  such  that 


(3.11)  =  [1  +  exp{-Da^(T-bj^) }  ] 

Thus  we  have 

(  I  =  [Da^]"^[log  -  log(l-Cgj^)]  + 

(3.12)  <  =  .1 

[  T  =  [Da^]  [log  Cg2  -  log(l-Cg2)]  +  \  • 

We  can  see  from  (3.12)  that,  if  c^j^  =  0  ,  then  t  =  -®  or  is  finite 
and,  if  c^2  “  1  »  then  t  =  «  or  is  finite.  We  obtain  for  the  total 
infonnation  Q 
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ll 


,1/2 


(3.13)  Q  -  1  :  ti  (0)1  '  de 

& 


Da^  ^  ^  [exp{Da^(T-b^) 

•  [1  +  exp{Daj^(T-b^)  }]  ^  dt 


Now  we  shall  further  define  t*  such  that 


(3.14)  T*  -  t*(t)  -  (exp{Daj^(T-bj^)  }] 


1/2 


Thus  we  have 


«.15) 


and  from  (3.12)  and  (3.14)  we  can  write 


(3.16)  j*  -  t*(t)  *  Cg^^^^(l-CgP”^^^ 


and 


*¥i 


(3.17) 


“*  1/2/,  ^-l/2 

T*  =  t*(t)  =  c  (l“C„o7 
g2  gZ 


We  obtain  from  (3.13),  (3.14),  (3.15),  (3.16)  and  (3.17) 


(3.18)  Q  -  2[tan"^{c„,/(l-c  .)}^^^  -  tan'^c  ,/(l-c  ,)}^^^1 

g2  gZ  gl  gl 


It  is  obvious  from  (3.18)  that,  when  item  g  belongs  to  Type  A  , 

i.e.,  c  ,  *  0  and  c  .  *  1  ,  as  is  the  case  with  the  normal  ogive  model 
g-*-  gZ 

or  with  the  logistic  model  on  the  dichotomous  response  level,  this  quantity, 
Q  ,  assumes  the  maximal  value,  with 
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(3.19)  Q  “  ir  , 

and  the  result  is  consistent  with  our  previous  finding.  We  can  also 

see  from  (3.18)  that,  as  c^j^  departs  from  zero,  and  from  unity, 

the  total  Information  Q  becomes  progressively  smaller  than  tt  .  In 

the  three  examples  shown  in  Figure  2-1,  we  obtain  Q  ■  2.214  for  both 

Types  B  and  D  ,  and  Q  =  1.287  for  Type  D  .  We  can  easily  see  from 

(3.18)  that  the  total  Information  Q  assumes  the  same  value  for  Types  B 

and  C  whenever  c  ,  ®  1  -  c  _  . 

gl  g2 

IV  Three-Parameter  Logistic  Model 

The  three-parameter  logistic  model  may  be  the  model  of  Type  B 

which  is  most  frequently  used  by  researchers.  The  logistic  model  was 

originally  developed  as  a  substitute  for  the  normal  ogive  model  because 

of  its  closeness  in  shape  and  the  mathematical  simplicity  which 

provides  us  with  a  simple  sufficient  statistic  for  the  response  pattern 

V  (cf.  Bimbaum,  1968).  Following  the  knowledge  or  random  guessing 

principle,  the  third  paramter,  c  ,  which  is  called  the  guessing 

g 

parameter,  was  added  to  the  model  to  change  it  to  the  three-parameter 
logistic  model.  Thus  we  have  for  the  item  characteristic  function  of 
the  three-parameter  logistic  model 

(4.1)  P  (e)  =  c  +  (1-c  )  (0) 

g  g  g  g 


where 


4*  (0) 

g 


-Da  (0-b  ),-l 
[1  +  e  g  g  J 


(4.2) 


The  function  given  by  (4.2)  is  the  item  characteristic  function  in  the 
logistic  model,  which  differs  by  no  greater  than  0.1  from  the  item 
characteristic  function  of  the  normal  ogive  model  given  by  (2.5), 
throughout  the  whole  range  of  d  ,  if  we  set  the  scaling  factor  D  equal 
to  1.7  .  It  is  obvious  from  (4.1)  that  the  three-parameter  logistic 
model  belongs  to  Type  B  ,  with  *  c^  . 

From  (3.18)  we  can  write  for  the  total  item  Information  for  the 
three-parameter  logistic  model 

-1  1/2 

(4.3)  Q  =  TT  -  2tan  ^[c  /(1-c  . 

S  g 

Since  the  total  item  information  Q  for  any  model  of  Type  A  is  ir  ,  the 

second  term  on  the  right  hand  side  of  (4.3)  indicates  the  Information 

loss  caused  by  the  lower  asymptote  c  ,  in  comparison  with  Q  in  any 

g 

model  of  Type  A  .  When  the  multiple-choice  test  item  has  five  alternatives 
c  =  1/5  =  0.20  ,  and  the  information  loss  is  as  large  as  0.295Tr  . 

s 

When  it  has  four  alternatives,  c  =  1/4  =  0.25  ,  and  the  information 

g 

loss  is  0.333w  ,  which  incicates  that  one-third  of  the  total  information 

is  lost  because  of  the  noise  caused  by  random  guessing. 

Figure  4-1  illustrates  the  information  loss  caused  by  the  noise 
in  the  three-parameter  logistic  model.  In  this  figure,  the  square  root 
of  the  item  information  function  of  item  h  ,  which  follows  the  logistic 
model  on  the  latent  trait  t  with  the  parameters,  a^  =  1.0  and 

b^  ®  0.0  ,  and  the  scaling  factor,  D  •  1.7  ,  is  drawn.  Thus  we  can  write 


(4.5) 


=  Da„  Pj(t)  (1-P*(t)]  ' 


The  total  area  under  the  solid  curve  in  Figure  4-1  equals  it  ,  and  the 

area  which  lies  on  the  left  hand  side  of  the  vertical,  dashed  line 

indicates  the  information  loss  caused  by  the  lower  asymptote,  c  =  0.20  , 

S 

and  that  of  the  vertical,  solid  line  corresponds  to  the  information  loss 
caused  by  c^  =  0.25  .  Table  4-1  presents  these  values  and  the 
corresponding  information  loss  for  each  of  the  four  other  cases  in  which 
c  =  0.100  ,  0.125  ,  0.333  and  0.500  ,  respectively.  In  the  same  table 
also  presented  are  the  value  of  x  ,  the  critical  value  9^  below  which 
the  item  response  information  function  for  u  =■  1  assumes  negative 

s 

values,  and  the  values  of  f  (9)  ,  P  (9)  and  I  (9)  at  9=9  for 

S  g  g  g 

each  case,  with  D  =  1,7  ,  a  =  4,  =  1.0  and  b  “  b,  =  0.0  . 

g  ^  g  h 

We  can  write  for  the  last  four  columns 


(4.6)  9  =  (2Da  )  log  c  +  b  , 

g  g  g  g 


(4.7)  4-  (6  )  =  [1  +  exp{-Da  (9  -b  )}]  ^  =  c  ^'"^(l+c  , 

gg  ggg  g  g 


(4.8) 


P  (9  )  =  c  +  (1-c  )'?  (9  )  =  c  '  , 

g  g  g  ggg  g 
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(4.9) 


.  1/2  1/2  -2 

s  g  g  g 


-1 


TABLE  4-1 

Information  Loss  Caused  by  the  Lower  Asymptote  of  the  Item  Characteristic 
Function  in  the  Three- Parameter  Logistic  Model  for  Each  of  the  Six  Values 
of  the  Asymptote  c^  ,  Together  with  x  ,  the  Critical  Value  e  and  the 

logistic  Function  ^^(e)  ,  the  Item  Characteristic  Function  P  (^e)  and  the 

9  9 

Item  Information  Function  ^g(®)  4t  ®  “  ®g  • 


T 

Information 

Loss 

e 

9 

S'  (e  ) 

9  9 

9  9 

n 

-1 .292 

0.644  (20.5%) 

-0.677 

0.361 

-1.145 

0.723  (23.0%) 

-0.612 

mm 

0.354 

0.361 

mm 

-0.815 

0.927  (29.5%) 

-0.473 

0.447 

0.341 

-0.646 

1.047  (33.3%) 

-0.408 

Hi 

0.500 

0.321 

0.333 

-0.408 

1.231  (39.2%) 

-0.323 

0.366 

0.577 

0.283 

0.500 

0.000 

1.571  (50.0%) 

-0.204 

0.414 

0.707 

0.205 

V  Item  Response  Information  Functions 


There  are  certain  models  for  binary  Items  which  assure  the 

existence  of  a  unique  maximum  for  the  likelihood  function  of  every 

possible  response  pattern,  such  as  the  normal  ogive  model,  the  logistic 

model,  etc.  In  fact,  except  for  the  two  extreme  response  patterns  In 

which  u  “  0  for  all  the  Items  and  u  ®  1  for  all  the  Items, 

&  g 

respectively,  the  likelihood  function  has  a  unique  local  maximum  In  those 
models.  It  has  been  pointed  out  (Samejlma,  1969,  1972)  that  a  sufficient 
condition  for  the  unique  maximum  is:  1)  that  the  basic  function,  which 
is  defined  by  (1.1),  is  strictly  decreasing  in  9  throughout  its  whole 
range,  and  2)  that  Its  upper  asymptote  Is  non-negative  and  Its  lower 
asymptote  is  non-positive.  For  brevity,  we  shall  call  it  the  unique 
maximum  condition.  This  condition  Implies  that  the  Item  response 
Information  function  is  positive  except,  at  most,  at  an  enumerable 
number  of  points  of  0  . 

It  has  been  shown  (Samejlma,  1972,  1973b)  that  the  three-parameter 

logistic  model  does  not  satisfy  the  unique  maximum  condition,  and  that  the 

likelihood  function  for  certain  response  patterns  has  more  than  one 

modal  point.  The  same  is  true  with  the  three-parameter  normal  ogive 

model.  This  is  one  of  the  serious  problems  which  are  caused  by  noise 

accomodated  by  a  three-parameter  model. 

In  this  chapter,  we  solely  consider  item  characteristic  fvinctions 

given  by  (2.4)  in  which  t  (0)  Is  the  item  characteristic  function  of 

g 

Type  A  that  satisfies  the  unique  maximum  condition.  For  simplicity,  let 

'l''(0)  denote  the  first  partial  derivative  of  f  (0)  with  respect  to 
g  8 

P  ,  and  ’{'"(0)  be  the  second  partial  derivative,  so  that  we  have 
g 


We  can  write  from  (1.1)  and  (2.4)  for  the  basic  function 


(5.3) 


A  (0)  r 

y-  <‘=82-=gl)’;<“>"8l*“=g2-V’A«>’'' 


Substituting  (5.3)  into  (1.6),  we  obtain  for  the  item  response  Information 
function 


<'5.4) 


=  [  (Cg^-Cgj^)^[  {r  (9)  }^+{i-'i-g(0)  }r(0)  ]+(i-Cg2^ 


-2 


I  (0) 
u 

g 


<'g2-'gl>  ''g<«  '  1  ‘l-=gl’-‘'‘g2-=gl'  ’  "g 


>  <'=g2-'=8l''"’;‘">  '  -■'g'®'  ’g'®'  '“gl' Vgl’  ’g‘°’ 

.-2 


[c  ,+(c  ,-c  i)'»’„(0)l 
^  gl  g2  gl  g 


For  the  models  of  Type  A  in  which  c  ,  *  0  and  c  _  =  1  ,  both  (5.3) 

gl  g2 


and  (5.4)  are  simplified  in  the  forms 


0 


(5.5) 


and 


(5.6) 


=  -'F' (0)  [l-'K  (9)3 
g  g 

A  (9) 

u  I  . 

®  '  =  Y'O)  ['!'  (9)1 

g  g 


[{'i''(0)}^+{l-’i'  (e)}4'"(6)][l-H'„(0)]'^ 


g 


1  =  [{'l"(0)}  -'V  (6)r'(0)]{'i'  (0)} 


g 

-2 


u  =  1 
g 


It  is  obvious  from  (5.5)  that  the  sign  is  reversed  for  the  two  A  (0)  ’s 

'^g 

for  any  fixed  value  of  9  .  Since  we  are  solely  dealing  with  the  item 

characteristic  functions  which  are  strictly  increasing  in  9  ,  and  4'  (0) 

g 

is  such  an  item  characteristic  function  of  Type  A  ,  we  can  say  that 

A  (0)  assumes  negative  values  for  u  =  0  except,  at  most,  at  an 

'^g  ® 

enumerable  number  of  points  of  0  where  it  is  zero,  and  it  assumes 

positive  values  for  u  =  1  except,  at  most,  at  an  enumerable  number 

6 

of  points  of  0  .  Since  we  also  deal  solely  with  which  satisfies 

the  unique  maximum  condition,  A  (9)  is  strictly  decreasing  in  9  and 


I  (9)  is  non-negative  throughout  the  whole  range  of  9  .  In  fact, 

'^8 

in  models  such  as  the  normal  ogive  model  and  the  logistic  model,  I  (9) 

*^8 

is  positive  everywhere  both  for  u  =  0  and  u  =  1  .  The  upper  and 

8  8 

lower  asymptotes  of  A  (9)  for  u  =  0  in  the  normal  ogive  model 

^8  ® 

are  zero  and  negative  infinity,  and  those  for  u  =1  are  positive 

8 

infinity  and  zero,  respectively.  On  the  other  hand,  the  two  asymptotes 


for  u  =  0  in  the  logistic  model  are  zero  and  -Da  ,  and  those  for 

s  s 

'^g  *  ^  are  OSg  and  zero,  respectively,  the  outcome  which  is  somewhat 
different  from  the  one  in  the  normal  ogive  model,  in  spite  of  its  similarity 
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in  the  shape  of  the  Item  character is tic  function  (cf.  Samejlma,  1969, 
1972) .  It  is  obvious  that  both  models  satisfy  the  unique  maximum 
condition. 

There  are  models  of  Type  A  which  do  not  satisfy  the  unique 

maximum  condition.  Consider,  for  example,  the  linear  model.  Its  item 

characteristic  function,  P  (0)  ,  is  given  by 

S 


(5.7) 


=  (0-a  )(B-a  ) 

p  (9)  ^  a  8  g 


g 


f; 


-1 


0 


a  <:  6  ^  6 
g  g 

otherwise  . 


It  is  obvious  that  this  model  belongs  to  Type  A  .  We  have  for  the  first 

and  second  derivatives  of  P  (0)  with  respect  to  8  for  the  interval, 

g 

a  <  0  <  6  , 


(5.8) 


^P  (0)  =  (6  -a  )"^ 
39  g  g  g 


and 


(5.9) 


39^  g 


P  (0)  =  0 


respectively.  Replacing  4*  (0)  and  its  derivatives  in  (5,5)  and  (5.6) 

g 

by  the  above  P  (0)  and  its  corresponding  derivatives,  we  obtain 
g 


(5.10) 


A  (0) 
u 

g 


=  -(6  -0) 
g 

=  (0-a  ) 

8 


-1 


u  =  0 

g 

u  =  1 


and 
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(5.11) 


{=  (B  -0)~^  >0  u  -  0 

®  2  ® 

=  (0-a  )  >0  u  =  1  . 


We  can  see  from  (5.10)  and  (5.11)  that,  while  the  basic  function  is 

strictly  decreasing  in  0  both  for  u  =  0  ,  and  for  u  =  1  ,  the  upper 

8  8 

3  are  -(3  -a  )  and  negative 
g  g  g 


and  lower  asymptotes  at  0  =  and  0 


infinity,  respectively,  for  u  =  0  ,  and  those  for  u  =  1  are  positive 

8  8 

infinity  and  (3  -a  )  .  Thus  it  does  not  satisfy  the  unique  maximum 
8  8 

condition  which  requires  that  the  upper  asymptote  for  u  =  0  be 

8 

non-negative  and  the  lower  asymptote  for  u  =  1  be  non-positive.  In 

8 

addition  to  this  fact,  since  the  linear  model  provides  us  with  a  strictly 

increasing  item  characteristic  function  only  for  the  interval,  ^  6  $  3  , 

3  8 

and  this  interval  varies  from  one  item  to  another,  we  must,  in  ge.ieral, 
restrict  the  Interval  of  0  to  the  intersectlor,  .'f  thost  ’  individual 
intervals,  and,  consequently,  the  two  asymptotes  will  possibly 
be  further  to  the  negative  and  positive  sides,  respectively. 

This  last  statement  is  applicable  even  for  models  which  provide 
us  with  item  characteristic  functions  that  satisfy  the  unique  maximum 
condition,  if  the  intervals  for  which  the  items  are  strictly  increasing 
are  defined  Individually  and  differ  from  one  another,  as  is  the  case 
with  the  linear  model.  Take,  for  example,  the  constant  information 
model  (Samejima,  RR-79-1,  RR-79-3) .  We  can  write  for  the  item 
characteristic  function  in  the  constant  information  model 


(5.12) 


p^(e) 


sin  [y  (6-6  )+(Tr/4)]  -[it/ (4y  )  ]+6  f  tt/ (Ay  )  ]+6 

8  8  go  o  8 


=  0 


otherwise , 


■■■if 
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where  y  and  6  are  Item  discrimination  and  difficulty  parameters, 
S  S 

respectively.  Substituting  this  for  t  (6)  in  (5.5)  and  (5.6)  and 

S 

rearranging,  we  can  write  for  the  basic  function  and  the  item  response 
information  function  defined  for  the  Interval  of  6  , 

-[it/(4y  )]  <  0  <  it/(4y  )  , 

O  O 


(5.13) 


\  (0) 
g 


-2y  tan[Y  (6-6  )+('it/4)]  u  *  0 
g  g  g  g 


2y  cotlY  (0-<S  )+(Tr/4)]  u  »  1  , 

8  8  6  g 


(5.14) 


(  =  2y  ^  sec^[Y  (0-6  )+(Tr/4)]  >0  u  -  0 
g  g  g  g 

®  I  =  2y  ^  csc^[Y  (0-6  )+(Tr/4)]  >0  u  -  1  . 
^  g  g  g  g 


We  can  see  from  these  two  formulae  that  the  basic  function,  A  (0)  , 

u 

g 

is  strictly  decreasing  in  9  both  for  u  =0  and  for  u  =  1  ,  and 

g  8 

its  upper  and  lower  asymptotes  are  zero  and  negative  infinity  for 

u  =0  and  positive  infinity  and  zero  for  u  *  1  ,  respectively, 
g  g 

Thus  the  unique  maximum  condition  is  satisfied  for  the  above  interval 
of  8  .  And  yet  it  is  not  satisfied  for  every  interval  of  0  ,  since 
the  interval  for  which  the  item  characteristic  function  is  strictly 
increasing  is  defined  individually  and  possibly  differs  from  the  one 
for  another  item.  We  must  take  the  intersection  of  the  n  individual 
intervals,  therefore,  and  for  that  subinterval  of  9  the  unique  maximum 


condition  is  not  satisfied  for  every  item,  unless  all  the  n  items 


are  equivalent  Items.  Note  that,  in  such  a  case,  the  unique  maximum 
likelihood  estimate  exists  for  every  response  pattern  regardless  of 
the  model,  and  is  obtained  from  the  test  score  which  is  a  simple 


sufficient  statistic  for  the  response  pattern  V  . 

For  models  of  Type  B  ,  in  which  c^2  “  1  »  we  can  simplify  (5.3) 
and  (5.4)  in  the  forms 


(5.15) 


/  =  -4''(0)[l-4'  (e)] 

J  s  g 


-1 


^  (6) 

«  1=  (l-Cg^)'F'(0)[Cg^+(l-Cg^)'i-^(6)r^ 


u  =  0 
g 


and 


(5.16) 


[{r  (9)}^+{l-'F  (0)}'?"(0)  ][!-'?  (0)]"^  u  =  0 

I  (0)  ■  ®  ^  ^ 

“el  2  2 

®  '  =  [(1-c  ,  )[{'{'•(  0)}-'?  (0)r’(0)]-c  ,(i-c  ,)r(0)] 

sf  g  g  g  gf  gi  g 

[c  ,+(l-c  (0)]“^  u  =  1  . 

gl  gl  g  g 


Comparison  of  these  formulae  with  (5.5)  and  (5.6)  reveals  that,  for  u  = 

g 


the  basic  function,  and  hence  the  item  response  information  function,  are 


the  same  as  those  in  models  of  Type  A  , while  those  for  u  =1  have  more 

g 


complicated  forms  than  the  counterparts  in  models  of  Type  A  because  of 


the  additional  terms  and  factors  which  include  c  ,  .  It  is  obvious, 

gl 


therefore,  that  the  basic  function  for  u^  *  0  satisfies  the  unique 


maximum  condition  and  the  corresponding  item  response  information  function 
is  positive  except,  at  most,  at  an  enumerable  number  of  points  of  0  , 
as  is  the  case  with  Type  A  .  We  can  see  from  the  second  line  of  (5.15) 


ffK 
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that  the  basic  fimctlon  for  =  1  is  positive  throughout  the  entire 

range  of  6  except,  at  most,  at  an  enumerable  number  of  points  where 

it  assumes  zero,  as  is  also  the  case  with  Type  A  .  We  can  also  see 

that,  if  the  asymptote  of  y'CB)  at  the  lower  end  of  6  is  zero,  as 

is  the  case  with  such  models  as  the  normal  ogive  and  logistic  models, 

the  as3ni>ptote  of  the  basic  function  for  u^  «  1  is  also  zero,  and  the 

function  cannot  be  strictly  decreasing  in  6  ,  and  in  such  a  case  there 

must  be  a  subset  of  6  for  which  the  item  response  information  function 

assumes  negative  values.  A  close  examination  of  the  second  line  of 

(5.16)  reveals  that  the  second  term,  -c  ,  (1-c  ,)4'*'(e)  ,  of  the  first 

gl  gl  g 

factor  on  the  right  hand  side  of  the  formula  cakes  an  Important  role  in 
specifying  the  subset  of  6  in  which  the  item  response  Information 


function  for  u^  =  1  is  negative. 

For  models  of  Type  C  ,  in  which  c^j^  =  0  ,  (5.3)  and  (5.4)  are 
simplified  Co  become 


(5.17) 


(5.18) 


"g  1^=  'r(0)['Pg(0)]"^ 


I  (0) 
u 

g 


[c  _^({y’(9)}^-y  (e)y;;(e))+c  ,'i'’'(0)][i-c„,w  (o)]"^ 
g2  g  g  g  g2  g  g2  g 

u  ■■  0 

[{4'*(6)}^-'i'  (0)^(0)  ][y„(0)]'^  u^  -  1 

g  g  g  g  g 


We  can  see  from  these  formulae  that,  contrary  to  the  case  of  models  of 

Type  B  ,  for  u  =1  both  the  basic  function  and  the  item  response 

information  functions  are  identical  with  those  in  the  models  of  Type  A  , 

while  for  u^  =  0  they  are  different  and  more  complicated  from  the 

counterparts  in  the  models  of  Type  A  .  Thus  it  is  obvious  that  the  basic 

function  for  u  =1  satisfies  the  unique  maximum  condition,  and  the 
g 

corresponding  item  response  information  function  is  positive  except,  at 

most,  for  an  enumerable  number  of  points  of  6  where  it  assumes  zero. 

Since  V  (0)  is  strictly  increasing  in  0  ,  the  basic  function  for 
g 

u  =  0  is  non-positive,  and,  if  the  asymptote  of  the  first  derivative 
g 

of  V  (0)  at  the  upper  end  of  0  is  zero,  as  we  find  in  the  normal 

s 

ogive  model,  in  the  logistic  model,  etc.,  the  asymptote  of  the  basic 

function  at  the  upper  end  of  is  zero,  so  the  basic  function  cannot 

be  a  strictly  decreasing  fxinction  of  0  .  The  unique  maximum  condition 

is  not  satisfied,  therefore,  for  u  =*  0  .  There  exists  a  subset  of 

9  for  which  the  item  response  information  function  assumes  negative 

values.  A  close  examination  of  the  first  line  of  (5.18)  reveals  that 

the  second  terra,  the  first  factor  on  the  right  hand  side 

of  the  formula  takes  an  important  role  in  determining  the  subset  of  9  in 

which  the  item  response  information  function  for  u  =  0  assumes 

g 

negative  values. 

For  models  of  Type  D  ,  (5.3)  and  (5.4)  are  directly  applied.  We 

can  see  from  (5.3)  that,  if  the  first  derivative  of  H*  (0)  tends  to  zero 

g 

at  both  the  upper  and  lower  ends  of  0  ,  as  is  the  case  with  the  normal 
ogive  model,  the  logistic  model,  etc.,  the  unique  maximum  condition  is 
not  satisfied  either  for  u  *  0  or  for  u  =  1  .  There  exists  a  subset 


9 
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of  8  in  which  the  item  response  information  function  assumes  negative 
values  for  each  item  score.  For  u^  -  0  .  the  second  term  of  the  first 

factor,  .  plays  an  important  role  in  determining 

this  subset  of  0  .  and,  for  u^  -  1  .  so  does  the  second  term  of  the 
first  factor,  -‘'gi(Cg2-Cgj^)y^'(0)  . 

When  fgCe)  is  given  as  the  item  characteristic  function  in  the 
normal  ogive  model,  we  can  write 


(5.19) 


(5.20) 


and 


(5.21) 


'^g(0)  »  (2it) 


-1/2 


/a  (e-b  ) 


-u^/2 


du  , 


l-^O)  =  a  (2ii)~’-''^  exp[-a  ^O-b  )2/2]  , 

*  8 


»"(e)  -  -a/(9-b^)r(e)  -  ^2,)-l/2(9-b„:cp[-a  ^9-b  )^/2) 

o  8  8 


When  we  substitute  them  Into  C5.15)  and  (5.16),  respectively,  we  have 

the  basic  function  and  the  item  response  Information  function  of  the 
three— parameter  normal  ogive  model. 


If  we  specify  that  t  (0)  be  the  item  characteristi 


ic  function  in 


the  logistic  model,  then  we  will  have 


(5.22)  y  (0)  =  [l+e"°®g^®“^g^]~^ 


(5.23)  ^(e)  =  Da  y  (0)fl-4'  (0)J  , 


and 
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(5.24) 


r(e)  =  Da  'l''(0)[l-2'l'  (6)]  =  D^a  ^4-  (0)  1  [l-ZS-  (6)  ] 

g  gg  g  ggg  B 


Substitution  of  (5.22)  into  (2.4)  provides  us  with  curves  for  the 

item  characteristic  functions  of  Types  A  ,  B  ,  C  and  D  which  are  similar 

to  those  which  are  illustrated  in  Figure  2-1,  in  which  the  item 

characteristic  function  of  the  normal  ogive  model  is  adopted  for  ¥  (0)  . 

g 

If  we  substitute  (5.22)  through  (5.24)  into  (5.5)  and  (5.6),  then  we 
will  obtain  the  basic  function  and  the  item  response  Information  function 
in  the  logistic  model.  Thus  we  can  write 


(5.25) 

1  : 

'  =  Da 
^  g 

and 

(5.26) 

S”'  i 

f  ■ 

[.  -  D^a 

=  -Da  4'  (0) 
g  g 


u  =  0 

g 

u  =  1 

g 


4'  (0)[l-4'  (0)]  >  0  u  =  0 
ggg  g 

^4*  (0)[l-4'  (0)]  >  0  u  =  1 
ggg  g 


It  is  obvious  from  (5.25)  and  (5.26)  that  the  basic  function  is  strictly 

decreasing  in  0  and  the  item  response  information  function  is  positive 

throughout  the  entire  range  of  0  ,  both  for  u  =  0  and  for  u  =  1  . 

g  g 

Since  the  item  response  information  function  is  the  same  for  u^  =  0 

and  u  =  1  ,  its  conditional  expectation,  i.e.,  the  item  information 
g 

function  I  (0)  ,  is  also  identical  with  the  item  response  information 

s 

function.  Figure  5-1  Illustrates  this  curve,  which  represents  the  item 

response  information  function  for  u  »  0  and  u  ■■  1  and  the  item 

information  function,  with  the  item  parameters,  a  >1.00  and  b  >  0.00  , 

g  g 

and  the  scaling  factor,  D  *  1.7  .  Since  this  example  is  of  Type  A  ,  we 
have  c^j^  *  0.000  and  c^2  *  1.000  as  the  third  and  fourth  parameters. 


0.01  I  .1,.  a,  .lA,  ti  I  ^ — I  I  I 

-&0  -4u0  -ao  -2.0  -1.0  ao  to  2.0  3.0  4.0  5.0 

LATENT  TRAIT  © 

FIGURE  5-1 

Three  Identical  Curves  for  the  Item  Response  Information  Function 
for  u  =0  and  u  ~  ^  and  the  Item  Information  Function  in 

g  g 

the  Logistic  Model  with  D  =  1,7  ,  ag  =  1.00  and  bg  =  0.00  , 
as  an  Example  of  the  Type  A  Model  . 


As  was  observed  earlier,  for  models  of  the  other  three  types. 
Types  B  ,  C  and  D  ,  one  of  the  two  curves,  or  both,  of  the  item  response 
information  function  has  a  subset  of  9  for  which  it  assumes  negative 
values.  Substitution  of  (5.22)  through  (5.24)  into  (5.3)  and  (5.4) 
provides  us  with  the  basic  function  and  the  item  response  information 
function  for  models  of  Type  D  in  the  forms 


(5.27) 


and 


(e)[l-4'„(e)][(l-c  ,)-(c^.,-c„,)4'  (0)  ] 


-1 


A.  (0) 


-g2  ''gr‘'“g 


gl'  "-82  '-gl'g' 


u  \  , 


u  =  0 
g 


"  Hc„,  +  (c^.,-c_,  )'1'_(9)  ] 


-1 


gl'  g2  gl'  g' 


“  (e)][(l-c  .Xl-H-  (9)}2-(1-c^,X4'  (0)}21 

g'^  g-*-  g  g  g  gl  g  g2  g 

[(1-c  )-(c  -c  .)f  (0)]"^  u  -  0 

gl  g2  gl  g  ^  g 


(5.28) 


(0) 

8 
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respectively .  For  Type  B  ,  in  which  c^2  “  1*000  ,  (5.27)  and  (5.28)  are 

further  simplified,  and  both  the  basic  function  and  the  item  response 

infomatlon  for  u  *  0  are  the  same  as  those  for  Type  A  ,  which  are 

g 

given  as  the  first  lines  of  (5.25)  and  (5.26),  respectively,  whereas  for 

u  *  1  we  obtain 
g 


(5.29)  A  (0)  -  (1-c  ,)Da  y  (0)[l-y  (0)]lc„.+(l-c  )y  (0)] 

u  gi  g  g  g  gl  gl  g 

O 


-1 


u  -  1 
g 


and 

(5.30)  I  (0)  -  (1-c  ,)D^a  ^y  (0)[i-y  (0)][{y  (0)}^-c  -{1-y  (0)}^] 

Ug  gl  g  g  g  g  gl  g 

[c  ,+(i-c  ,)y  (0)]  ^  u  =  1  . 

gl  gl  g  g 

For  Type  C  ,  in  which  c^j^  =  0.000  ,  both  the  basic  function  and  the  item 

response  information  function  for  u^  *  1  are  identical  with  those  for 

Type  A  ,  which  are  given  as  the  second  lines  of  (5.25)  and  (5.26),  respectively. 


and  for  u  *  0  we  can  write 
g 


(5.31) 


and 


A  (0)  »  -c  -Da  y  (0)[l-y  (0)][l-c  _y  (0)]'^  u  =  0 

u  g2  g  g  g  g2  g  g 

O 


(5.32)  I  (0)  -  c  ,D^a  ^y  (0)[i-y  (0)]l{i-y  (0)}^-(i-c  ,){y  (o)}^] 

Ug  g2  g  g  g  g  g2  g 

ti- -  0  . 

Figure  5-2  presents  the  three  sets  of  the  item  response  information 
and  the  item  information  functions  of  Type  B  .  In  this  figure,  the 
two  curves  for  the  item  response  information  function  are  drawn  by 
solid  lines,  and  the  one  for  the  item  information  function  is  shown  by  a 
dashed  line.  Note  that  they  are  the  information  functions  in  the  three- 
parameter  logistic  model.  The  item  parameters  adopted  here  are,  again. 
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FIGURE  5-2 
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Item  Response  Information  Function  (Solid  Lines)  and  Item  Information 
Function  (Dashed  Line)  of  Type  B  Model:  Logistic  Function  Is  Used  for 
f  (0)  with  a  =  1.00,  0  =  1.7  and  b  =  0.00,  and  specified  c„,  . 


equals  0 . 125 


a  -  1.00  and  b  =  0.000  ,  and  the  third  parameter,  c  .  , 
g  g  gl 


In  the  first  graph,  0.200  In  the  second  graph  and  0.250  in  the  third 
graph,  respectively,  and  the  scaling  factor  D  is  set  equal  to  1.7  . 

Note  that  these  three  values  correspond  to  the  guessing  parameters  when 
there  are  eight,  five  and  four  alternatives  in  the  multiple-choice  test 
item,  respectively.  As  was  observed  in  a  previous  study  (Samejima,  1973b), 
there  is  a  subinterval  on  the  negative  side  of  6  for  which  the  item 


response  information  function  assumes  negative  values  for  u^  =  1  . 


In  contrast  to  the  above  result,  the  corresponding  Information 
functions  for  Type  C  are  illustrated  in  Figure  5-3.  Both  the  item 


discrimination  parameter,  a  ,  and  the  item  difficulty  parameter,  b  ,  as 

g  g 


well  as  the  scaling  factor  D  ,  are  the  same  as  in  the  preceding  examples. 


with  c^2  “  0.875  in  the  first  graph,  Cg2  ~  0.800  in  the  second  graph. 


and  c^2  “  0.750  in  the  third  graph,  respectively.  We  can  see  that,  in  each 


of  these  three  examples  of  Type  C  ,  there  is  a  subinterval  on  the  positive 
side  of  0  for  which  the  item  response  information  function  assumes 


negative  values  for  u  =0 

g 


Figure  5-4  presents  nine  examples  of  the  corresponding  sets  of 
information  functions  for  Type  D  .  In  these  examples,  both  the  item 


discrimination  parameter  a  and  the  item  difficulty  parameter  b  ,  and 

g  g 


the  scaling  factor  D  ,  are  the  same  as  those  in  the  preceding  examples. 


and  all  the  nine  possible  pairs  of  c^j^  “  0.125,  0.200,  0.250  and 


c^2  “  0.875,  0.800,  0.750  are  adopted.  In  the  first  three  graphs,  there 


is  the  relationship,  c^j^  =•  1  -  c^2  »  resultant  two  curves  of 


the  item  response  information  function  are  symmetric  with  6  >  0.000  as 
the  axis  of  symmetry,  while  in  the  other  six  graphs,  the  above  relationship 


does  not  hold  between  c^j^  and  c^2  »  the  two  curves  of  item  response 


-&0  -40  -ao  -ao  -to  ao  to  ao  ao  4jo  so 


LATEMT  TIIAIT  B 


-ao  -40  -ao  -ao  -to  ao  to  ao  3.0  40  ao 

LATENT  TRAIT  • 

FIGURE  5-3 

Item  Response  Information  Function  (Solid  Lines)  and  Item  Information 
Function  (Dashed  Line)  of  Type  C  Model:  Logistic  Function  Is  Used  for 
f„(9)  with  a„  =  1.00,  D  =  1.7  and  =  0.00,  and  specified  c„,  , 
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FIGURE  5-4 

Item  Response  Information  Function  (Solid  Lines)  and  Item  Information 
Function  (Dashed  Line)  of  Type  D  Model;  Logistic  Function  Is  Used  for 
4'g(e)  with  ag  =  1.00,  D  =  1.7  and  bg  =  0.00  ,  and  Cg^  and  Cg2 

As  Specified. 
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Information  function  are  not  symmetric.  We  can  see  that,  tn  each  example, 

there  is  a  subinterval  on  the  negative  side  of  6  for  which  the  item 

response  information  function  is  negative  for  u  =  1  ,  and  another 

g 

subinterval  on  the  positive  side  of  8  for  which  it  assiunes  negative 

values  for  u  =  0  . 

g 

Let  6  denote  the  critical  value  of  8  below  which  the  item 
-g 

response  information  fxmction  of  Type  B  or  D  assumes  negative  values  for 

u  =  1  ,  and  8  be  the  one  above  which  the  item  response  information 
8  8 

function  of  Type  C  or  D  takes  on  negative  values  for  u  «  0  .  In  general, 

g 

we  can  write 


(5.33)  0g  =  -(2Dag)*^  [log  -  log  c^^]  +  b^ 
and 

(5.34)  Sg  =  flog  ~  ’^g  ' 


Since  b  *  0.00  in  all  our  examples,  the  absolute  values  of  8  and  8 
g  -g  g 

are  the  same  whenever  c  ,  =*  1  -  c  »  .  These  critical  values  are  shown 

gl  g2 

in  Figures  5-2  through  5-4, 

Figure  5-5  presents  the  square  root  of  the  item  information  function 
for  each  of  the  three  examples  of  Type  B  ,  in  contrast  to  the  one  for 
Type  A  ,  which  is  drawn  by  a  dotted  line.  We  can  see  in  this  figure  that, 
as  c^j^  becomes  larger,  the  total  information  Q  grows  smaller.  Since 
each  example  follows  the  three-parameter  logistic  model,  the  amount  of 


Information  loss  is  the  same  as  the  one  given  in  Table  4-1  ,  in  which 


c  is  given  as  c 
gl  g 

Similar  results  were  obtained  for  the  three  examples  of  Type  C 


-5.0  -40  -ao  -2.0  -IjO  0.0  1.0  2.0  3.0  40  5.0 


LATENT  TRAIT  O 

FIGURE  5-5 

Square  Root  of  the  Item  Information  Function  for  Each  of  the 
Three  Hypothetical  Items  of  Type  B  (Solid  Line)  in  Contrast 
to  the  One  Following  the  Logistic  Model  with  D  =  1.7  , 
a^  =  1.00  and  =  0.00  (Dotted  Line).  Values  of  Cg-j 

Are:  0.125  ,  0.200  and  0.250  ,  from  Top  to  Bottom. 


and  are  shown  in  Figure  5-6.  Equation  (3.18)  indicates  that  the  information 
loss  in  Type  C  is  identical  with  the  one  in  Type  B  whenever  =  1  -  c^^^  . 

Thus  the  information  loss  for  c^^  ®  0.875  in  Type  C  is  the  same  as 
the  one  for  c^^^  =  0.125  in  Type  B  ,  and  so  forth,  and  the  amount  of 
information  loss  for  each  of  our  three  examples  of  Type  C  can  be  found 
in  Table  4-1  . 

Equation  (3.18)  also  indicates  that  the  amount  of  information  loss 

is  additive  for  Type  D  ,  in  which  c  ,  is  non-zero  and  c  is  not  unity. 

gl  g2 

Figure  5-7  presents  the  square  root  of  the  item  information  function 
for  each  jf  our  nine  examples  of  Type  D  ,  using  four  graphs  for  the  sake 
of  comparison.  We  can  see  in  this  figure  that,  in  each  case,  the  total 
information  Q  is  substantially  smaller  than  the  one  for  Type  A  ,  which 


77.0^ 

70.5% 


0.875 

0.800 

0.750 


66.7% 
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FIGURE  5-6 

Square  Root  of  the  Item  Information  Function  for  Each  of  the 
Three  Hypothetical  Items  of  Type  C  (Solid  Line)  in  Contrast 
to  the  One  Following  the  Logistic  Model  with  D  =  1.7  , 
a^  =  1.00  and  =  0.00  (Dotted  Line).  Values  of  Cgg 

Are;  0.875  ,  0.800  and  0.750  ,  from  Top  to  Bottom. 


equals  ir  .  The  amount  of  information  loss  in  each  case  can  be  obtained, 
again,  from  Table  A-1  ,  by  simple  additions.  To  give  an  example,  if 

=  0.125  and  ~  0.800  ,  then  the  amount  of  information  loss  is 

0.723  +  0.927  =  1.650  ,  or  23.0%  +  29.5%  =  52.5%  . 


VI  Speed  of  Convergence  of  the  Conditional  Distribution  of  the 


Maximum  Likelihood  Estimate,  Given  Latent  Trait .  to  Nonnalit' 


In  a  previous  study,  the  speed  of  convergence  of  the  conditional 
distribution  of  the  maximum  likelihood  estimate  6^  ,  given  0  ,  to  normality 
was  observed  through  a  Monte  Carlo  study,  using  the  constant  information 
model,  whose  item  characteristic  function  is  given  by  (5.12)  (cf.  Samejima, 
RR”79-3) .  In  that  study,  eight  equally  distant  ability  levels,  which 
start  from  -3.0  and  end  with  2.6  ,  were  used,  and  one  hundred  examinees 


FIGURE  5-7 

3f  the  Item  Information  Function  for  Each  of  the  Nine  Hypothetical  Items  of  Type  D 
le)  Arranged  for  Comparison,  in  Contrast  to  the  One  in  the  Logistic  Model  with 
^  =  1.00  and  =  0.00  (Dotted  Line).  Values  of  c^i  and  Cg2  Are 

Specified  in  Each  Graph. 
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were  hypothesized  on  each  ability  level.  There  were  twenty  sessions  in 

the  hypothetical  testing  situation,  and  ten  test  items  were  administered 

in  each  session.  Those  items  were  all  equivalent  items,  with  the  common 

parameters,  y  *  0.25  and  6  =  0.00  .  The  interval  of  9  for  which 

each  item  characteristic  ftmctlon  assumes  positive  values  is,  therefore, 

-ir  <  6  <  IT  .  The  maximum  likelihood  estimate  of  ability  was  obtained  for 

each  hypothetical  examinee,  on  the  basis  of  the  simple  test  score  of  all 

the  test  items  administered  up  to  and  including  the  last  session  completed. 

If,  for  Instance,  session  17  was  completed,  then  the  TnaTti™™  likelihood 

estimate  of  ability  for  each  examinee  would  be  obtained  from  his  or  her  test 

score  of  the  170  test  items.  The  resultant  frequency  distribution  of  the 

maximum  likelihood  estimates  of  the  one  hundred  hypothetical'  examinees  was 

—1/2 

compared  with  the  asymptotic  normal  distribution,  N(6,  1(0)  )  . 

For  convenience,  hereafter,  we  shall  use  t  Instead  of  9  for 
the  ability  dimension  in  the  above  study.  One  rather  crude  measure  of 
the  speed  of  convergence  to  normality  is  the  frequency  of  one  of  the 
terminal  maximum  values  of  the  estimate.  If  this  frequency  is  large, 
then  the  resultant  frequency  distribution  will  not  be  able  to  approximate 
the  normal  distribution.  In  the  above  example,  these  terminal  maximxim 
values  are  -  ir  and  it  . 

Table  6-1  presents  the  frequencies  of  -x  on  the  left  half,  and 
those  of  X  on  the  right  half.  To  make  the  Implication  of  the  result 
easily  understandable,  the  table  was  artificially  enhanced,  by  using  the 
frequencies  of  x  for  t  *  0.2,  1.0,  1.8  and  2.6  ,  frequencies  of  -x  for 
T  »  -0.2,  -1.0,  -1.8  and  -2.6  ,  frequencies  of  -x  for 

T  •  -3.0,  -2.2,  -1.4  and  -0.6,  and  frequencies  of  x  for  t  =  3.0,  2.2,  1.4, 
and  0.6  ,  respectively.  We  can  see  from  this  table  that  the  convergence  to 
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er  (Right)  Terminal  Maximum  Values, 
d  Estimate  of  t  after  Each  Session,  in 
e  Constant  Information  Model  Were  Given. 
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normality  becomes  much  slover  as  0  approaches  either  -ir  or  . 

We  shall  consider  the  transformation  of  t  to  6  on  which  the 
common  Item  characteristic  function  In  the  constant  Information  model 
becomes  the  one  In  the  model  described  by  (2.4).  This  transformation 
Is  made  by 


(6.1)  0  »  4'  ^[(c  _-c^,)"^{sin^lY  (t-6  )+(7r/4)]-c  .  }]  . 

g  gl  g  g  gl 


We  can  see  from  (6.1)  that  the  transformation  depends  upon  the  functional 

formula  for  S'  (0)  . 

g 

Equation  (6.1)  also  Implies  that  the  lower  asymptote  of  x  is  the 
value  of  T  which  satisfies 


sin  [Y_(t-6  )+(Tr/4)]  -  c  , 


(6.2) 


0 
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From  (6.2)  we  obtain  for  the  lower  asymptote,  t  , 


(6.3)  T  -  Y  '^[sin'^c  /^^-(ti/4)]  +  6  . 

“  g  gl  g 


We  also  find  from  (6.1)  that  the  upper  asymptote  of  t  in  the  transformation 
is  the  value  of  t  which  satisfies 


(6.4)  sin  [y  (t-6  )+(Tr/4)]  -  c  ^  =  c  .,-c  . 

g  g  gl  g2  gl 


Thus  we  can  write  from  (6.4)  for  the  upper  asymptote,  t  , 


(6.5)  7  =  Y  ’^(sin'^c  o^'^^-(ir/4)  ]  +  (S 

g  g2  g 


Note  that  neither  t  nor  x  is  affected  by  the  functional  formula  for 

4*  (9)  ,  and,  except  for  the  parameters  y  and  6  ,  x  depends  solely 

g  g  g 

upon  ,  and  x  upon  •  (6.3)  and  (6.5)  imply  that  these  two 

asymptotes  equal  the  lower  and  upper  asymptotes  of  the  interval  of  x 
for  which  the  item  characteristic  function  in  the  constant  information 
model  assumes  positive  values,  if,  and  only  if,  c^^^  “=  0.000  and  c^2  ”  1*000 
Note  that,  since  models  of  Type  A  satisfy  this  condition,  Table  6-1  is 
directly  applicable  for  any  model  of  Type  A  ,  if  we  transform  x  to  9 
through  (6.1)  with  c^^  =  0.000  and  c^^  ®  1.000  and  specifying  Y  ^  . 

For  the  other  three  types,  either  all  the  maximum  likelihood  estimates 
which  are  less  than,  or  equal  to,  x  must  be  transformed  to  the  lower 
terminal  maximum  value  of  9  ,  or  those  which  are  greater  than,  or  equal 


to,  X  to  the  upper  terminal  maximum  value  of  9  ,  or  both. 


since  in  our  example  y  =  0.25  and  6  =  0.00  ,  for  c  ,  =  0.200 

g  g  gl 

we  obtain  t  =  -1.287  ,  and  for  =  0.800  we  have  t  =  1.287  . 

Table  6—2  presents  the  frequencies  of  the  lower  terminal  maximum  thus 
Increased  by  setting  t  =  -1.287  ,  as  well  as  those  of  the  upper  terminal 

a 

by  setting  t  =  1.287  .  For  convenience,  the  values  of  t  are  still  used 

in  the  table  instead  of  the  transformed  values  of  0  .  Since, 

by  transformation,  the  first  five  values  of  t  in  the  upper  half  of  the 

table  and  the  last  five  values  of  x  in  the  lower  half  of  the  table  are 

thrown  out  of  the  range,  the  frequencies  in  those  tec  columns  would  have 

been  unobservable,  had  we  used  the  Monte  Carlo  method  directly  by  adopting 

the  types  of  models  we  are  considering  now.  If  our  model  is  of  Type  D 

with  c^j^  =  0.200  and  ~  0.800  ,  then  those  frequencies  in  Table  6-2 

excluding  the  above  ten  columns  should  be  considered.  If  our  model  is 

of  Type  C  with  c^2  “  0.800  ,  then  the  lower  half  of  Table  6-2  ,  excluding 

the  last  five  columns,  plus  the  left  half  of  Table  6-1  should  be  adopted 

for  our  consideration.  If  our  model  is  of  Type  B  with  c^^  =  0.200  , 

then  the  upper  half  of  Table  6-2  ,  excluding  the  first  five  columns,  plus 

the  right  half  of  Table  6-1  should  be  considered. 

When  'V  (0)  is  specified  by  the  logistic  function  shown  by  (5.22), 
g 

we  can  rewrite  (6.1)  into  the  form 


(6.6) 


0  =  (Da  )  ^[log{sin^[Y  (t-6  )+(Tr/4)]-c 

g  g  g  gl 

-log{c  „-sin^[Y  (t-6  )+(Tr/4)]}]  +  b 
g2  g  g  g 


If  we  set  Y  ~  0.25  and  6  =  0.00  ,  as  we  did  before,  then  (6.6)  will 

g  g 

depend  solely  upon  the  two,  three  or  four  parameters  of  the  model  we 


choose.  If,  further,  we  set  b  =  0.00  ,  and  c  ,  =  0.200  for  models  of 

g  gl 

Types  B  and  D  and  c  _  =  0.800  for  models  of  Types  C  and  D  ,  then 


TABLE  6-2 

Frequencies  of  Lower  Terminal  Maximum  Value  of  the  Maximum  Likelihood  Estimate 

of  0  (Above)  and  Those  of  the  Upper  Terminal  Maximum  Value  of  the  Maximum 

Likelihood  Estimate  of  0  (Below)  When  9  Is  Transformed  from  x  with 

c  ,=  0.200  and  c  o  =  0.800  ,  Respectively,  after  the  Completion  of  Each 
gl  g-i 

of  the  Twenty  Sessions.  Table  Was  Converted  from  Table  6-1  . 


Session 


-3.0  -2.6  -2.2  -1.8  -1 


1.0  1.4  1.8  2.2  2.6  3. 


00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 
00  100 


99  89 

00  90 

00  93 

00  97 

00  96 

00  97 

00  98 

00  99 

00  96 

00  99 

00  99 

00  100 

00  100 

00  100 

00  100 

00  100 

00  100 

00  100 

00  100 

00  100 


65  48 

73  40 

68  31 

74  26 

79  22 

73  21 

78  17 

78  13 

75  12 

76  8 


27  12 


-46- 


(6.6)  will  depend  soley  upon  the  discrimination  parameter,  a 

S 

Since  we  can  write  for  the  slope  of  the  item  characteristic 

function,  P*(t)  ,  in  the  constant  information  model 
g 


(6.7) 


^  P*(t)  =  2y  sin[y  (t-S  )+(it/4)1  cos[y  (t-6  )+(ir/4)  ] 
oT  K  'g  g  g  g  K 


g  g 


with  Y  =  0.25  and  6  =  0.00  ,  we  obtain  t —  P*(0)  =  0.25  .  For  the 

g  g 

corresponding  slope  of  the  item  characteristic  function,  P  (6)  ,  we  obtain 

g 


(6.8) 


—  P  (e)  =  (c  -c  )Da  f  (e)[l-y  (6)]  , 
30  g  g2  gl  g  g  g 


and  with  b  =  0.00  we  have  P  (0)  =  0.25(c  _-c  ,)l>a  .  If  we  equate 

g  36  g  g2  gl  g 

these  two  slopes,  we  obtain  for  the  discrimination  parameter 


(6.9) 


a  =  D  (c  --C  ,) 
g  g2  gl 


When  we  set  D  =  1,7  ,  and  c^^^  =  0.200  for  Types  B  and  D  and  c^^  ®  0.800 

for  Types  C  and  D  ,  we  have  for  Type  A  a  =•  0.58824  ,  for  Types  B  and  C 

g 

a  =  0.73529  ,  and  for  Type  D  a  =  0.98039  .  Thus  we  can  see  that,  in 
g  g 

order  to  maintain  the  same  slope  at  the  origin  of  the  scale  as  the  original 
common  item  characteristic  function  in  the  constant  information  model, 
we  must  choose  the  discrimination  parameter  specified  above,  for  each 
type  of  model.  Because  of  the  noise,  the  discrimination  parameter  must 
be  larger  for  the  model  of  Type  B  or  C  in  comparison  with  the  one  for  the 
logistic  model,  which  is  of  Type  A  ,  and  it  must  be  largest  for  the  model 


of  Type  D  . 
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A  similar  result  is  obtained  in  this  specific  example  when  we 

equate  the  amount  of  item  information  at  the  origin  of  the  scale.  Since 

we  have  for  the  item  Information  function  I*(t) 

g 

(6.10)  I*(t)  =  [~P*(t)]^[P*(t){1-P*(t)}]"^  , 

g  g  g  g 

we  obtain  for  the  above  parameters  of  the  common  item  characteristic 

function  in  the  constant  information  model  I*(0)  =  0.25  .  On  the  other 

g 

hand,  from  (1.7),  (1.2),  (2.4)  and  (6.8)  we  can  write 


(6.11) 


From  (6.11),  we  obtain  I  (0)  =  0.25(c  --c  .)^D^a  ^(c  ,+c  _)  ^(2-c  ,-c  .) 

g  g2  gl  g  gl  g2  gl  g2 

Equating  these  two  amounts  of  item  Information,  we  can  write  for  the 
discrimination  parameter  a^ 


(6.12) 


-1,  .  .1/2,.,  .1/2,  .-1 

a  =  D  (c  1+c  _)  (2-c  ,-c  „)  (c  -c  .) 

g  gl  g2  gl  g2  g2  gl 


With  D=  1.7  and  c  ,  =  0.200  for  Types  B  and  D  and  c  „  =  0.800  for 

gl  g2 

Types  C  and  D  ,  we  obtain  a  =  0.58824  for  Type  A  ,  a  =  0.72044 

g  g 

for  Types  B  and  C  ,  and  a  =  0.98039  for  Type  D  . 

g 

Tables  6-3  through  6-6  present  the  values  of  6  transformed  by 


(6.6)  for  each  of  the  four  types  of  models,  with  y  =  0.25  ,  6  *  0.00 

g  g 

b  *0.00,  D=1.7,  and  c  ,  *  0.200  for  Types  B  and  D  and 

g  gl 

c^2  ~  0.800  for  Types  C  and  D  ,  using  four  different  values  of  a^  , 
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Transformed  e  from  x  witli  the  Logistic  Transformed  e  from  t  with  the  Legist 

Function  with  D  =  1 .7  ,  a^  =  1.50  and  Function  with  D  *  1.7  ,  a  =2.0  and 

b  =  0.00  for  1-  (0)  .  c  ,  =  0.200  for  b  =  0.00  for  .  c  ,  =  0.200  for 


2.533 


0.50  ,  1.00  ,  1.50  and  2.00  ,  respectively,  for  each  of  the  sixteen 
values  of  t  shown  in  Tables  6-1  and  6-2  .  Comparison  of  the  result 
for  Type  B  with  that  for  Type  A  reveals  that  the  values  of  6  corresponding 
to  T  ■  -2.2  for  Type  A  are  a  little  larger  in  absolute  value  than  those 
corresponding  to  t  ••  -1.0  .  If  we  compare  the  frequencies  in  the  column 
for  T  “  -1.0  in  the  upper  half  of  Table  6-2  in  comparison  with  those 
in  the  column  for  t  =  -2.2  in  the  left  half  of  Table  6-1  ,  however, 
we  find  that  the  convergence  is  substantially  slower  in  the  former  case. 
Although  in  the  former  no  frequencies  of  the  lower  terminal  maximum  are 
observed  after  administering  seventy  equivalent  items,  in  the  latter  we 
still  have  three  after  administering  two  hundred  items,  which  shows  the 
effect  of  noise  in  the  models  of  Type  B  on  the  speed  of  convergence  of 
the  conditional  distribution  of  the  maximum  likelihood  estimate,  given 
9  .  If  we  compare  the  columns  for  Type  B  across  the  four  tables. 

we  will  find  out  this  slow  convergence  occurs  at  the  level  of 

9  closer  to  the  origin  as  the  discrimination  index,  a  ,  Increases. 

8 

The  values  of  9  corresponding  to  x  =  -1,0  are:  -2.950  ,  -1.475 
-0.983  and  -0.737  for  a  *  0.5  ,  1.0  ,  1.5  and  2.0  ,  respectively, 

O 

the  fact  which  indicates  that  the  effect  of  noise  is  much  more  serious 

when  the  discrimination  parameter  a  is  greater.  An  identical  observation 

8 

can  be  made  when  we  compare  the  result  for  Type  C  with  the  one  for 
Type  A  ,  in  which  the  frequencies  of  the  upper  terminal  maximum  are 
considered.  The  effect  of  noise  is  even  more  conspicuous  for  Type  D  , 
as  is  expected  from  its  formula  for  the  item  characteristic  function. 

These  four  tables  disclose  that  the  value  of  9  for  x  *  -1.0  for 
Type  D  is  approximately  the  same  as  the  value  of  0  for  x  -  -1.8  for 
Type  A  in  each  case,  and  comparison  of  the  frequencies  in  the  column  for 


T  “  —1.0  in  the  upper  half  of  Table  6—2  with  those  in  the  column  for 

T  "  1.8  in  the  left  half  of  Table  6—1  reveals  a  greater  contrast.  In 

the  latter,  the  convergence  is  substantially  faster,  showing  no  frequencies 

of  the  lower  terminal  maximum  after  the  administration  of  sixty  equivalent 

items.  An  identical  result  is  observed  for  the  frequencies  of  the 

upper  terminal  maximum.  It  should  be  noted  that  these  slow  convergences 

are  observed  at  6  *  -0.645  and  0  =*  0.645  ,  i.e.,  close  to  the  origin, 

for  a  >  2.0  ,  which  indicates  even  more  serious  effect  of  the  noise 

g 

in  Type  D  models  when  the  discrimination  parameter  is  large. 

VIl  Discussion  and  Conclusions 

The  effect  of  noise  in  models  for  the  dichotomous  itesn  has  been 
observed,  with  respect  to  three  types  of  models.  Types  B  ,  C  and  D  ,  in 
comparison  with  Type  A  ,  which  does  not  Include  noise.  It  has  been  shown 
that  the  information  loss  caused  by  the  noise  is  substantial,  and  the  speed 
of  convergence  of  the  conditional  distribution  of  the  maximum  likelihood 
estimate  of  the  latent  trait,  given  the  true  latent  trait,  to  normality 
decreases  substantially. 

The  author's  standpoint  has  been  that  we  should  try  to  eliminate 
noise  by  constructing  "good"  test  items,  since  noise,  which  may  be  caused 
by  guessing,  is  nothing  but  nuisance,  and  its  undesirable  effect  is 
probably  greater  than  most  researchers  think.  This  attitude  of  the  author 
is  reflected  in  the  paper  published  as  early  as  in  1972  (Samejima,  1972), 
in  which  a  general  model  for  free-response  data  is  proposed.  It  is  also 
reflected  in  the  proposal  of  a  new  family  of  models  (Samejima,  RR-79-4), 
which  implies  that  "good  distractors"  in  the  multiple-choice  test  item 


will  effectively  reduce  noise.  If  we  do  not  have  a  technique  to  extract 
precious  metal  from  ore,  ore  Itself  will  be  useless,  however  precious 
the  contained  metal  may  be.  In  the  three-parameter  logistic  model,  for 
example,  there  is  no  such  technique  Involved,  and  the  Item  characteristic 
function  is  defined  for  the  "correct”  answer,  which  Is  contaminated  by 
noise . 

Because  of  general  indifference  and  the  wide  acceptance  of  the 
three-parameter  logistic  model,  however.  It  seems  necessary  that  someone 
should  quantify  the  effect  of  noise  Incorporated  In  such  models,  and  clarify 
what  we  sould  do  to  supplement  the  loss.  If  possible.  The  present  paper 
is  the  first  of  such  attempts.  If,  for  example,  some  researchers  wish  to 
use  the  author's  methods  and  approaches  for  estimating  the  operating 
characteristics  of  discrete  item  responses  (Samejima,  1977,  RR-77-1,  RR-78-1 
through  RR-78-6,  RR-80-2,  RR-80-4,  RR-81-2,  RR-81-3,  Final  Report),  using 
a  set  of  test  items  following  the  three-parameter  logistic  model  as  the 
Old  Test,  they  should  take  the  effect  of  noise  Into  consideration;  without 
it  the  research  may  even  by  ruined. 

In  the  future,  this  problem  of  noise  may  not  be  a  serious  consideration. 
With  the  progress  of  technology  and  a  wider  use  of  on-line  systems,  the 
multiple-choice  test  items  will  become  less  and  less  Important,  and  with 
a  proper  effort  by  researchers  free-response  test  Items  will  become  more 
and  more  common.  In  such  a  case  models  for  free-response  data,  including 
both  for  discrete  test  Items  and  for  continuous  test  Items  (Samejima,  1973a, 
1974)  will  become  more  useful.  In  the  meantime,  however,  we  must  be  extra 
careful  In  handling  models  which  Include  noise,  like  the  three-parameter 
logistic  model. 
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